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The  best  of  the  known  algorithms  for  testing  isomorphism  of  general 


undirected  graphs  have  running  times  exponential  in  n*  the  number  of 
vertices.  To  increase  the  efficiency  of  testing  isomorphism*  heuristics 
are  often  used.  Typically*  these  heuristics  partition  the  vertices  into 
classes  with  given  properties  and  thereby  reduce  the  number  of 
bijections  that  must  be  checked  as  possible  isomorphisms  [3*  11].  Even 
successful  classification  of  the  vertices  into  disjoint  sets  of  size  S3 
leaves  an  exponential  number  of  maps  to  check. 


L.  Babai  [3]  explored  algorithms  for  testing  isomorphism  of  graphs 
whose  vertices  have  been  partitioned  into  classes  of  size  k  or  less*  for 
some  fixed  k.  He  was  able  to  exhibit  a  polynomial -time  Las  Vegas 
algorithm*  i.e.  an  algorithm  in  R  n  coR*  to  solve  this  problem.  He  also 
observed  that  no  subexponential  deterministic  algorithm  was  known.  Our 
first  result  provides  a  polynomial- time  algorithm  for  this  problem. 
Specifically*  we  exhibit  an  algorithm  to  test  color  preserving 
isomorphism  of  two  vertex-colored  graphs  in  which  each  color  class  is  of 
size  k  or  less.  In  addition*  we  obtain  generators  for  the  automorphism 
group  of  such  a  graph  in  polynomial  time. 


A  group  G  acting  on  U*...*n}  is  said  to  be  recognizable  jj&  tine 
1(a)  if  the  question  "is  x  in  G?"  is  decidable  in  T(n)  time.  A  tower  of 
groups  G  *  Gq  n  Gj  •••  a  Gf  =  1  is  called  polvnomiallv  aCAMflihle  if 

(i)  generators  are  known  for  G* 

(ii)  each  G^  is  recognizable  in  polynomial  time* 
and  (iii)  IC^/G^jl  S  p(n),  for  some  polynomial  p, 
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Our  second  result  is  that  the  size  of.  and  generators  for.  any 
group  which  is  polynomial ly  accessible  via  such  a  tower  can  be 
determined  in  polynomial  time.  This  gives  a  polynomial-time  algorithm 
for  computing  the  automorphism  group  of  a  vertex-colored,  graph  with 
bounded  color  multiplicity.  It  also  solves,  in  polynomial  time,  the 
isomorphism  testing  problem  for  such  graphs  [3]. 

C.  Hoffmann  [9]  exhibited  a  Las  Vegas  algorithm  for  determining  the 
automorphism  group  of  a  trivalent  cone  graph  in  time  0(nc*°^n)  using  a 
recursive  application  of  Babai's  algorithm.  We  improve  this  result  and 
give  a  deterministic  0(nc*c~*a)  algorithm  for  computing  the  automorphism 
group  of  a  slightly  more  general  structure. 

Finally,  we  address  the  problem  of  testing  isomorphism  of  trivalent 

graphs.  The  best  previously  known  algorithm,  attributed  to  G.  Miller, 

runs  in  time  0(cn)  for  some  constant  c.  Testing  trivalent  graph 

isomorphism  can  be  polynomial- time  reduced  to  computing  the  automorphism 

group  of  a  trivalent  graph  in  which  one  edge  is  fixed.  It  is  a  well 

known,  and  easy  to  prove,  theorem  of  Tutte's  that  such  an  automorphism 
k 

group  has  order  2  for  some  integer  k.  Exploiting  the  unique  properties 
of  groups  with  order  a  power  of  a  prime,  and  using  the  improvements  to 
Babai's  and  Hoffmann's  algorithms,  we  derive  a  subexponential 
(0(nc*°®n))  algorithm  for  trivalent  graph  isomorphism. 
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2.  folyaomiaily  Accessible  lowers  of  Croups 

A  permutation  group  on  (l*...in)  is  a  collection  of  1-1  maps  from 

{1 . n}  onto  itself  that  forms  a  group.  Let  G  be  a  group*  |G|  stands 

for  the  order  of  G. 

Let  H  be  a  subgroup  of  G.  The  symbol  G/H  stands  for  the  collection 
of  cosets  of  H  in  G»  i.e.»  the  collection  of  equivalence  classes  in 
which  x  =  y  if  and  only  if  x  *y  is  in  H.  From  Lagrange's  theorem  we 
know  that  every  coset  of  G/H  has  the  same  size  and  that 
IG I  =  I G/H |  x  |H|. 

If  gj . gk  are  permutations  then  <g1*...»gk>  stands  for  the  group 

of  all  permutations  formed  by  products  of  the  g^. 

2.1  Towers  of  Groups 

L.  Babai  [3]  seems  to  have  been  the  first  researcher  to  suggest 
that  computing  the  size  of  an  unknown  group  might  be  facilitated  by 
first  trapping  that  group  in  a  tower.  He  used  this  technique  on  the 
automorphism  groups  of  vertex-colored  graphs  of  bounded  color 
multiplicity  and  the  automorphism  groups  of  graphs  with  bounded 
eigenvalue  multipicity.  By  trapping  such  groups  in  polynomially 
accessible  towers  he  was  able  to  calculate  their  size  in  polynomial 
time  using  coin  tossing  algorithms.  Our  first  result  is  a  polynomial 
time  deterministic  algorithm  for  this  problem. 

Theorem  1.1:  Let  G  »  Gj  s  mo  G{  *  I  be  *  polynomially  accessible 
tower  of  groups.  Coset  representatives  for  Gj/G^j,  i=0,...,r-l,  can  be 


determined  in  polynomial  time 


Proof  i  Let  max  IG^/G^I  =  k.  We  will  construct  a  table  with  r  rows* 

numbered  0  to  r-l«  and  k  columns  whose  ith  row  is  a  set  of  right  coset 
representatives  for  Gj/G^+j.  The  group  G  can  be  expressed  as 

G  s  Go  =  <VGl>V 

or*  G  =  (Gq/Gj) (GJ/G2) • • «(Gr_ j/Gf ) . 

Therefore*  any  element  g  in  G  can  be  written  in  the  form 

g  =  aoal***ar-l*  w^ere  *i  an  ®l«nent  Gi^Gi+l* 

The  table  should  have  the  following  property:  g  is  in  G  if  and  only 
if  g  can  be  expressed  as  ao*l*#**r-l  where  a^  is  a  member  of  the  ith 
row.  A  permutation  g  is  in  canonical  form  when  it  is  written  this  way. 

Ve  start  with  a  table  whose  rows  contain  only  the  identity  element. 

The  procedure  sift(x)*  defined  below  modifies  the  table  so  that  the 
element  x  from  G  can  be  written  in  canonical  form. 

aift(x): 

i  ♦  0 

while  (i  *  r-1  and  there  is  a  y  in  row  i  such  that  y  x  is  in  G 

dfi 

i  «►  i  +  1 


fid 

if  x  is  not  the  identity  then  insert  x  in  row  i 

As  an  example  of  how  sift  works*  suppose  the  table  for  the  tower 
G0  3  G1  3  G2  3  G3  =  *  at  *0De  point  looks  like  Figure  2.1. 


k 
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(C0*)  I  I  I  Gj  ♦  »  *  I  Gj  ♦  I _ |  Gj 

<Gj«)  I  1-1  G2  ♦  I _ [  G2  ♦  | _ |  G2 

(g2«)  I  1  I  g3  ♦  I _ I  g3  ♦  I _ I  g3. 

Figure  2.1  State  of  table  after  eift(a). 


Conaider  aift(b)  for  some  b  is  Gq  but  not  in  G^.  If  a  H  ia  in  Gj, 
and  a  *b  ia  not  in  G2>  then  after  the  call  aift(b)  the  table  would  look 
like  Figure  2.2*  at  which  point  b  *  a(a  *b)  ia  expressible  in  canonical 
fora. 


1 _ 1 _ 1  I _ a _ 1  1  1 

1  1  1  a"1b  1  1 

1 

I  1  l  1  1  L 

Figure  2.2  State  of  table  after  aift(b). 


If  we  had  tine  to  aift  every  element  of  G»  then  we  would  be  sure 
that  every  clement  of  G  could  be  expressed  in  canonical  form. 

At  this  point  we  make  a  key  observation:  all  of  the  coset 
representatives  have  been  found  if  and  only  if 

(1)  Each  generator  can  be  written  in  canonical  form, 
and  (2)  Each  product  of  a  pair  of  representatives  in  the  table  can 
be  written  in  canonical  form. 

Since  the  only  elements  ever  sifted  into  the  table  are  from  G  we 
need  only  verify  that  when  (1)  and  (2)  are  satisfied  any  g  in  G  can  be 
written  in  the  canonical  form.  Let  g  be  an  element  of  G.  Write  g  as  a 


... ...  ’'^|it^|H^ff--V- r  -^c-  \  -  ■  ■  -  - z  ■ .  -  ..  ^  -  •''•T*y^f,ttt9^ss** 
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product  of  generators  and  write  each  generator  in  canonical  form.  If 
this  product  is  not  in  canonical  form*  we  use  (2)  to  rewrite  it. 

By  using  (2)  we  can  take  an  adjacent  pair  of  representatives  x.y  in 
the  string  representing  g  and.  if  x  comes  from  a  higher  numbered  row 
than  y(  rewrite  xy  in  canonical  form.  This  has  the  effect  of  moving  an 
element  from  a  lower  numbered  row  past  an  element  of  a  higher  numbered 
row  to  the  left  in  the  string.  Moving  all  the  row  0  representatives  to 
the  left,  then  all  the  row  1  representatives,  and  so  on.  we  can  put  the 
string  in  canonical  form.  It  is  important  to  note  here  that  writing  xy 
in  canonical  form  does  not  require  the  introduction  of  any  elements  from 
rows  numbered  less  than  the  one  y  comes  from. 

The  whole  algorithm  can  be  described  as 
Step  1.  Sift  all  the  generators. 

Step  2.  Sift  the  product  xy  for  every  pair  x.y  in  the  table. 

The  timing  analysis  is  straightforward.  The  number  of  coset 
representatives  in  the  table  is  at  most  m»  some  polynomial  in  n.  The 
number  of  calls  to  sift  is  at  most  m  and  each  call  to  sift  takes 
roughly  k(r-l)p(n)  time,  where  p(n)  is  a  polynomial  that  bounds  the 
amount  of  time  to  test  membership  in  any  G^.  Therefore,  the  running 
time  is  polynomial  in  n. 

□ 

An  immediate  corollary  is  an  algorithm  much  like  the  one  proposed 
by  C.  Sims  [12]. 
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Corollary  1.2:  Let  C  be  a  group  of  permutations  generated  by  g^ . 

Let  G^  be  the  subgroup  of  G  that  fixes  l»...*i.  Then  coset 
representatives  for  Gj/G^+^  can  be  determined  in  polynomial  time. 
Furthermore.  this  gives  a  polynomial-time  decision  procedure  for  testing 
membership  in  G  and  for  determining  the  order  of  G. 

Proof  :  Use  the  algorithm  described  in  the  previous  theorem  to  compute 
the  coset  representatives.  The  only  modification  is  that  to  test 
vhether  x  and  y  are  inequivalent  members  of  G^/G^  just  check  that  they 
map  i+1  to  different  places. 

Once  the  coset  representatives  have  all  been  found*  testing 
membership  is  not  hard.  To  determine  if  x  is  an  element  of  G,  run  the 
procedure  sift  with  argument  x.  If  x  can  be  written  in  canonical  form, 
then  x  has  been  written  as  a  product  of  generators.  If  x  cannot  be 
written  in  cannonical  form,  then  x  is  not  in  G. 

The  order  of  G  is  the  product  of  the  sizes  of  G^/Gj.+j. 

D 

3.  Computing  Inter.8eca.iQfl  al  Zxa  Groups 

Consider  the  problem  of  computing  the  automorphism  group  of  a  graph 
G.  Suppose  it  were  possible  to  partition  the  edges  of  G  into  two 
classes.  A  and  B.  in  such  a  way  that  every  automorphism  of  G  fixed, 
setwise,  these  classes.  Let  and  Xg  be  the  automorphism  groups  that 
preserve  the  A  edges  and  the  B  edges  of  G  respectively.  The 
permutations  in  the  intersection  of  X^  and  Xg  are  exactly  the 


automorphisms  of  G 


If  we  had  a  fast  algorithm  for  computing  the  intersection  of  two 
groups »  then  we  could  compute  the  automorphism  group  of  G  inductively. 
At  present  ve  do  not  know  how  to  take  the  intersection  of  an  arbitrary 
pair  of  groups  in  polynomial  time.  Using  the  following  theorem, 
however,  we  can  get  the  intersection  of  two  groups  under  special 
circumstances. 


Theorem  3.1:  Let  G  and  H  be  any  tvo  polynomial-time  recognizable  groups. 
Let  S  be  a  group  for  which  generators  are  known.  If  S  contains  both  G 
and  H.  and  there  are  tvo  polynomial ly  accessible  towers,  one  from  S 
through  G  to  I.  and  the  other  from  S  through  H  to  I.  then  generators  for 
GnH  can  be  found  in  polynomial  time. 


Proof  :  Let  S  =  HQ  m  •••  m  =  H  :>  Hr+1  =>•••=>  =  I,  and 

S=Gq3  3  Gj  =  G  3  ®p+l  3  **•  3  ^q-1  =  *  be  the  two  towers. 

Construct  an  8  *  q  table  whose  i.jth  entry  is  the  group  G^nHj.  Each 
entry  is  a  recognizable  group  since  it  is  the  intersection  of 
recognizable  groups. 


Both  |Hj/Hj+j |  and  |G^/G^+^ I  are  bounded  by  some  polynomial  p(n). 
Consider  the  tvo  groups  G^nH.  and  G^nHj^.  Let  a  and  b  be  distinct 
coset  representatives  of  X  =  (G^nHj)/(G£nHj+j) .  The  elements  a  and  b 
are  both  from  the  group  Hj.  Furthermore*  if  a  ^b  were  an  element  of 
Hj+j .  it  would  also  be  an  element  of  G^nHj+j .  Since  a  and  b  are  from 
different  cosets  of  X  it  follows  that  a  b  is  not  in  Hj+j.  Therefore, 
and  b  are  distinct  coset  representatives  of 


a 


Hence 
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|(G^nHj)/(GjnHj+j) |  is  less  than  or  equal  to  |H j/H |  i  p(n) . 

Similarly,  l(GinHj)/(Gi+1nHj) |  S  p(n). 

Let  P  be  any  path  in  the  table  beginning  at  S,  moving  only  one  row 
down  or  one  column  across  at  a  time,  passing  through  GnH,  and  ending  at 
I.  This  path  P  describes  a  polynomially  accessible  tower  of  groups  from 
S  through  GnH  to  I. 

For  example,  the  tower 

S  »  Hj_  »  Hj  »  •••  »  H  »  G^nH  s  •••  a  GpnH  m  GnH  =>  Gp+j.nH  3  •••  3  I  can 
be  used  to  get  generators  for  GnH  in  polynomial  time. 

D 


4.  Ih£  Sylow  Theorems .  Z-Groupa.  and  Imprimitivity 

The  automorphism  group  of  a  trivalent  graph  with  one  edge  fixed  is 

•  Ic  k 

a  2-group,  i.e.  it  has  order  2  for  some  k.  Groups  of  order  p  ,  where  p 

is  a  prime,  have  special  structure  which  we  will  exploit  later.  In  this 

section  we  state  some  of  the  standard  theorems.  For  more  detail  we 

refer  the  reader  to  [8]. 

v  ' 

Theorem  (Sylow):  If  G  is  a  group  and  2  is  the  largest  power  of  two 

k 

dividing  |G|  then  G  contains  a  subgroup  of  order  2  .  Such  a  subgroup  is 
called  a  2  Sylow  subgroup  (2SSG). 

Theorem  (Sylow):  All  2SSG’s  of  a  group  G  are  isomorphic. 
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Theorem  (Sylow):  Let  S  be  a  subgroup  of  G.  If  S  is  a  2-group  then  S  is 
contained  in  a  2SSG  of  G. 

The  2SSG's  of  SQ  have  the  following  characterization  in  terms  of 
the  automorphism  group  of  binary  trees. 

Theorem  4.1:  Let  S  be  any  2  Sylow  subgroup  of  Sq»  where  n  is  a  power  of 
2.  The  group  S  can  be  viewed  as  the  action*  on  the  leaves*  of  the 
automorphism  group  of  a  complete  binary  tree  whose  leaves  are  the 
vertices  l*...,n  in  some  order. 

Proof  :  Draw  the  graph  of  a  complete  binary  tree  whose  leaves  are  the 

vertices  1 . .  in  some  order.  Label  the  internal  nodes  of  the  tree  by 

the  permutation  of  the  leaves  obtained  when  the  node's  children  are 
interchanged.  Let  the  group  of  the  tree  be  the  group  generated  by  these 
permutations.  Since  all  2SSG's  of  SQ  are  isomorphic*  and  the  group  of 
the  tree  is  a  subgroup  of  Sn*  all  we  need  show  is  that  the  order  of  this 
group  is  the  largest  power  of  two  dividing  (n!). 

The  group  of  the  tree  has  order  2  to  the  power  of  the  number  of 

internal  nodes*  i.e.  2n  *.  The  factors  of  n!  divisible  by  2  are 

1  x  2*  2  x  2*...*(n/2)  x  2.  Thus  the  highest  power  of  two  dividing  nt 

is  (n/2)  +  r  where  r  is  the  largest  power  of  two  dividing  (n/2)!.  By 

k 

induction*  k  =  (n-1)  is  the  largest  number  such  that  2  divides  (nt)  for 
n  a  power  of  2.  From  this  we  conclude  that  every  2SSG  of  SR  can  be 
viewed  as  the  automorphism  group  of  a  binary  tree  whose  leaves  are 
(1 . n}  in  some  order. 
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□ 

If  n  is  not  a  power  of  two,  a  2SSG  of  SQ  can  be  shown  to  be  the 
group  induced  by  automorphisms  of  a  forest  of  full  binary  trees. 

Example  :  Any  2SSG  of  S^  is  isomorphic  to  the  group  induced  by  the 
automorphisms  of  the  trees  in  Figure  4.1. 
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Figure  4.1  A  2SSG  of  Sg. 


4.1  Imprimitive  Groups 

Let  G  be  a  permutation  group  on  {l.....n}.  Suppose  {l....,n}  can 

be  partitioned  into  disjoint  sets  Sj..,.»Sn  such  that  every  permutation 

in  G  either  maps  all  the  elements  of  onto  or  onto  the  elements  of 

another  S-.  If  S1(...»S_,  can  be  chosen  in  a  non-trivial  way.  i.e.  not 
j  l  m 

just  one  universal  set  or  n  singleton  sets,  then  G  is  called 
imprimitive.  and  the  sets  are  called  domains  or  S£±&  ol 
imprimitivitv. 

Every  2SSG  of  SQ  has  n/2  sets  of  imprimitivity  of  size  2.  n/4  of 

size  4.  etc.  These  correspond  to  leaves  of  subtrees  of  height  1.2 . 

respectively.  Since  every  2-group  of  permutations  is  contained  in  a 
2SSG  of  Sn«  each  is  imprimitive. 


4.2  Computing  vith  2-groups 


Let  G  be  some  2-group.  In  this  section  ve  show  how  to  find 
Syl(G)t  a  2SSG  of  SQ  containing  G,  in  polynomial  time.  Ve  then  show  how 
to  determine  a  polynomial ly  accessible  tower  from  Syl(G)  through  G  to  I. 
Using  this  result  and  the  intersection  theorem,  it  will  be  possible  to 
calculate  the  intersection  of  any  two  2-groups  that  are  subgroups  of  a 
single  2SSG. 

Theorem  4.2:  Let  G  =  <g^,...,g^>  be  a  2-group  acting  on  {l,...,n}. 
Syl(G),  a  2  Sylow  subgroup  of  SQ  containing  G,  can  be  found  in 
polynomial  time. 

Proof  :  Since  G  is  a  2-group  and  is  therefore  contained  in  some  2SSG  of 
SQ,  G  must  be  imprimitive  and  have  domains  of  imprimitivity  contained  in 
those  of  the  2SSG.  In  particular,  G  must  have  n/2  domains  of 
imprimitivity  of  size  2,  corresponding  to  the  leaves  of  subtrees  of 
height  1  in  the  tree  representation  of  the  2SSG. 

Such  a  collection  of  sets  can  be  located  quickly.  First  find  a 
pair  (i-QOQ)  whose  orbit  under  G  contains  only  disjoint  pairs.  To  find 
the  orbit  of  a  pair,  use  a  transitive  closure  algorithm  on  the  action  of 
the  generators.  The  collection  of  pairs  in  the  orbit  of  (ig,jg)  fora 
domains  of  imprimitivity  of  size  2  for  G.  Since  the  group  G  acts  as  a 
2-group  on  the  vertices  not  in  this  orbit,  this  algorithm  can  be  applied 
repeatedly  until  all  the  vertices  are  paired  up  into  domains  of 
imprimitivity  of  size  2. 
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Since  G  is  a  2-group*  the  action  of  G  on  this  collection  of  pairs 
must  also  be  a  2  group*  say  G^.  A  cycle  x  of  non-pover-of-tvo  length  in 
Gj  would  imply  the  existence  of  a  non-power-of-two  length  cycle  in  G. 

By  determining  a  collection  of  sets  of  imprimitivity  of  size  two  in 
Gj  we  also  determine  domains  of  imprimitivity  of  size  4  in  G. 

Continuing  recursively*  we  can  obtain  partitions  of  {l»...*n}  into  sets 
of  imprimitivity  of  sizes  2*4*8*... »2n  ^  with  respect  to  G.  In  turn* 
these  domains  of  imprimitivity  specify  a  unique  2SSG  with  the  same 
domains.  This  2SSG*  call  it  Syl(G)»  contains  all  permutations  on 
{l*...*n}  that  respect  its  domains  of  imprimitivity.  Since  every 
permutation  of  G  respects  its  domains  of  imprimitivity*  G  is  contained 
in  Syl(G) . 

0 

Having  obtained  Syl(G),  a  2SSG  of  Sn  containing  G*  we  now  want  to 
determine  a  polynomial ly  accessible  tower  from  Syl(G)  through  G  to  I. 

The  top  portion  of  the  tower*  Syl(G)  =  Hy  3  Hr_j  3  •••  3  sG,  will  be 
defined  by  letting  =  <G*a^*...*a^>*  where  the  a^  are  elements  of 
Syl(G).  These  a^  must  be  chosen  with  some  care  so  that  is 

bounded  by  a  polynomial*  and  Hr  =  Syl(G). 

Let  S  be  any  2-group.  It  can  be  shown  [8]  that  there  is  a  tower  of 
groups  S  *  Sr  s  Sr_^  a  •••  a  Sq  =  I  in  which  ISj/S^I  *  2.  For  the 
special  case  in  which  S  =  Syl(G)  is  a  2SSG  of  SR*  it  is  possible  to  find 
a  sequence  a^*...*ar  such  that  can  be  taken  to  be  <a^*...»a^>. 


T*"""a  4.3:  LeC  S  be  a  2  Sylov  subgroup  of  SQ»  n  =  2  •  In  polynomial 
time  it  is  possible  to  determine  a  sequence  of  elements  a|»...»ar  of  S 
such  that 

(I)  (a.)2  =  1. 

(II)  a^  commutes  with  every  element  of  S/<aj»...»a£„^>» 
and  (III)  S  =  <aj«.*.»ar>. 

Proof  :  The  proof  is  by  induction  on  the  height  of  the  binary  tree 
representing  S.  When  n  is  2.  the  height  of  S  is  1  and  S  is  the  tree  in 
Figure  4.2.  where  a  is  the  permutation  (1  2).  For  this  tree  the 
sequence  would  be  a^  =  a. 

V 

Figure  4.2  The  2SSG  of  Sj. 

Suppose  S  is  of  height  k  and  it  is  known  how  to  determine  such  a 


sequence  for  any  tree  of  height  k-1 .  The  tree  representing  S  can  be 
viewed  as  having  a  root  with  two  subtrees  of  height  k-1  attached.  Figure 
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Figure  4.3  The  2SSG  S. 


By  Che  induce  ion  hypothesis*  ve  find  «  sequence  for  the 

left  subtree*  L.  The  right  subtree*  R*  is  isomorphic  to  L  using  the  msp 
m:L  ■»  R  in  which  m(y)  =  xyx.  Therefore*  ve  can  take  the  sequence 
b1*....br*  with  =  xa^x,  to  be  «  sequence  for  R. 

The  claim  is  that  the  sequence  ajbj.  »j»  *2b2*  a2 . *rbr'  ar*  x 

satisfies  (I)»  (II).  and  (III)  for  S. 

Since  a^  and  b^  operate  on  disjoint  setB  of  vertices,  a^bj  =  b^a^. 
for  any  i  and  j.  It  follows  that  each  member  of  this  sequence  satisfies 
condition  (I).  Ve  must  demonstrate  two  things  to  prove  that  condition 
(II)  is  satisfied. 

(1)  The  element  a^b^  commutes  with  each  of  the  generators 
ai*ai+lbi+l . .  of  S/<albl . ai-l>  5 

Since  a^  and  commute,  and  a^  *  a2  s  •••  *  *£„i  8  bj  *  •••  =  b^.^  =  1 
in  S/<a^b^*...*a£_^>*  it  follows  that  a^b^  commutes  vith  each  generator* 
except  perhaps  x.  By  algebra* 
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■  (x*jx)«-x 

*  bax 

11 


*  *ib£*. 


Therefore*  a^b^  commute*  with  every  element  of  S/<ajbj*...»a£_j>. 
(2)  The  element  a^  commute*  vith  each  of  the  generator* 

*i.lbi*l . *rbr**  S/<*lbl . ‘iV  ■ 

It  ia  certainly  the  case  that  a^  commute*  vith  all  the  generator* 
vith  the  possible  exception  of  x*  Thu*  all  ve  need  to  *hov  i*  that 
a^x  «  xa^.  By  algebra* 

a.x  *  a. (a.b. )x»  aince  a.b.  «  1 
i  ill  i  i 


Thi*  ahova  that  a^  commute*  vith  every  element  of 

S/<*jb£*.. .*a<b<>. 

Clearly  condition  (X1Z)  i*  satisfied.  Therefore*  the  sequence 
*lbl*  x  ••tiafic*  (I). (II).  and  (III). 

□ 

In  the  event  that  n  is  not  a  pover  of  tvo*  Syl(C)  i*  represented  by 
a  forest  of  full  binary  tree*.  The  direct  product  of  the  automorphism 
group*  of  the**  tree*  i*  Syl(C).  Therefore*  a  sequence  for  8yl(G)  i* 
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th«  conca tenat ion  of  *equeneea»  one  for  each  of  the  treea. 

Theorem  4.4:  Let  C  8  <gj,...,g^>  be  a  aubgroup  of  a  2SSG  S  of  SQ.  Let 
*l,*2,***'*r  k*  *  eequeace  aatiafying  condition*  (I),  (II),  and  (III)  of 
Lena  4.3*  The  groupa  G  c  c  . ..  c  Hf  =  S,  where 

»  <G»  a^,  a2*...»  a^>,  fora  a  recognizable  tower.  Furthermore,  the 
index  of  in  ia  no  larger  than  2. 

Txoof.  :  Each  of  the  groupa  ia  recognizable  aince  generator*  for  it  are 
available.  If  we  ahow  that  normal izea  we  will  be  done  aince 

thia  would  imply  that  Hi+J  equala  either  IT ,  or  (Hi  ♦  a^H.). 

Consider  the  homomorphiam  f^  from  S  into  S  *  S/<a^». . ,,a^>.  Let 
be  the  image  of  in  S  under  f^.  The  element  a^+j  commute a  with  every 
element  of  S  ao  normalizea  in  S.  Since  contain*  the  kernel, 

<a^,...,a^>,  of  f^,  the  normalizer  of  in  S  contain*  the  preimage, 
under  f^»  of  the  normalizer  of  in  S.  Therefore,  a^  i»  in  the 
normalizer  of  H^. 

□ 

Since  G  ia  a  group  of  permutation*,  there  ia  a  tower  of 
recognizable  groupa  G  a  Cj  o  ...  a  i  where  ia  the  aubgroup  of  G  that 
fixe*  verticea  l,...,i.  From  thia  we  get  the  following  important 
corollary. 

Cagflllary  4.5:  If  G  ia  a  2-group  with  generator*  g^,...^,  a 
polynomial ly  acceaaible  tower  from  Syl(G)  through  G  to  I  can  be  located 
in  polynomial  time. 

j. 

t 

t 
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The  major  theorem  of  thie  taction  says  that  given  two  2 -groups 
which  are  subgroup*  of  a  common  2SSG*  generator*  for  their  intersection 
can  be  found  in  polynomial  time* 

Theorem  4*6:  Let  G  =  <g1 . gk>,  H  =  <hj,...,hr>  be  two  2  groups,  and 

let  S.  a  2SSG  containing  them,  be  given.  Generators  for  GnH  can  be 
determined  in  polynomial  time. 

Proof  :  Use  Corollary  4.5  to  construct  two  polynomial ly  accessible 
towers,  one  from  S  through  G  to  1.  the  other  from  S  through  H  to  I.  Use 
Theorem  3.1  to  calculate  the  generators  for  GnH. 

□ 


5.  Conn  firaphi  and  Hoffmann' a  Algorithm 

Definition:  A  Jtnne  granh  on  the  vertices  1 . .  is  the  graph  of  a 

complete  binary  tree  with  leaves  l....»n*  together  with  a  hypergraph  on 
l».*.n.  If  G  and  H  are  cone  graphs  of  the  same  sise.  their  union  G  +  H 
is  called  a  double  cone  graph.  The  vertices  of  cone  graphs  and  double 
cone  graphs  can  be  partitioned  into  classes  called  levels  corresponding 
to  distance  from  the  leaves.  The  leaves  are  at  level  0  and  the  roots 
are  at  level  logn.  Figure  5.1  is  an  example  of  a  cone  graph. 


Figure  5.1  A  cone  greph  with  4  hyperedges 


Ve  prove  Che  following  lemma  in  a  fashion  similar  to  the  one  used 
by  C.  Hoffmann  in  [9].  Using  this  lemma  ve  will  be  able  to  compute  the 
automorphism  group  of  a  cone  graph  in  deterministic  time  0(nc*ogn),  an 
improvement  over  Hoffmann's  probabilistic  result. 

f.— —  5.1:  Let  C  ♦  H  be  a  double  cone  graph  whose  hyperedges  are  no  more 
than  k-ary  for  seme  fixed  constant  k.  The  automorphism  group  of  G  *  S 
mapping  roots  onto  roots  can  be  determined  in  time  0(nclogn). 

FxOflf  :  Let  *  be  any  1-1  map  from  the  vertices  of  G  to  the  vertices  of  H 
that  preserves  tree  edges.  For  each  i*  define  the  group  U^(G)  (U^(H)) 
to  be  the  automorphism  group  of  the  cone  graph  G  (H)  that  preserves  tree 
edges  and  fixes  vertices  at  levels  i  and  above.  Let  U^(G.H.s)  be  the 
group  U^(G)  x  U^(H)  x  <s>.  An  element  (g.h.s)  in  U^C.H.s)  is  the 
permutation  ghs  on  G  ♦  H.  He  define  A^CG.H.s)  to  be  the  subgroup  of 
0^(G,B,*)  that  preserves  the  hyperedges  of  G  ♦  H. 

The  automorphism  group  of  C  ♦  H  is  thus  Aj0gn(G.H,t) .  In  order  to 
get  generators  for  this  group  we  obtain  generators  for  the  groups 
A£(CvH,s)/A£_j(C*H,s) .  Since  A^C.H.x)  o  A^(C,H»«)  the  union  of  the 
generators  for  the  quotient  groups  generate  A|0^n(C.H.r) . 


A 


By  a  classical  isomorphism  theorem  [6]» 


Ai(G,H,r)/Ai_1(G,H,x)  =  Ai<G*H.z)U._1(G,H.z)/Ui_1(G,H.z) .  Each  of  these 
groups  describes  the  action  of  A^  on  the  level  i-1  vertices.  It  is  the 
latter  group  that  we  trap  in  the  tower 

Ui/Ui.i  5  3  •••  3  Wt  *  Ai(G,H,a)Ui_1/Ui_1  3  V1  3  "*  3  =  I,  where 

stands  for  U^G.H.z).  The  groups  Vj  are  just  subgroups  of  Wfc  fixing 
successively  more  vertices.  The  Wj  are  a  little  harder  to  describe.  To 
define  them  we  have  to  construct  a  sequence  of  graphs. 

Let  Xq  be  the  binary  trees  of  G  ♦  H  without  any  of  the  hyperedges. 
The  first  group  in  the  tower*  U^(G,H,z)/Uj_j(G»H,z) ,  describes  the 
action  of  the  automorphism  group  of  Xq  on  level  i-1  vertices.  Each 
element  of  this  group  can  be  represented  by  a  0-1  assignment  to  level  i 
vertices  together  with  a  0  or  a  1  indicating  whether  the  trees  G  and  H 
should  be  interchanged  according  to  z.  A  1  assigned  to  a  level  i  vertex 
means  interchange  his  sons*  a  0  means  leave  them  alone. 

Pick  a  vertex  v  from  among  the  level  i  vertices  in  G.  Let  Xj  be  Xq 
plus  all  of  the  unary  hyperedges  on  leaves  of  the  subtrees  rooted  at  v 
in  G  and  z(v)  in  B.  Let  X2  be  Xj  plus  the  unary  edges  from  the  subtrees 
rooted  at  w  and  z(w)  for  some  other  level  i  vertex  w  in  G.  Continue  in 
this  fashion  until  the  graphs  Xq  c  ...  c  3^  ,  where  is  the  number  of 

level  i  vertices  in  G»  have  been  defined. 

After  processing  the  unary  hyperedges,  process  the  binary  edges* 
then  the  ternary  edges*  etc.  until  all  of  the  hyperedges  of  G  +  H  have 
been  incorporated  into  a  graph*  X(.  This  yields  a  sequence  of  graphs 
Xq  e  Xj  c  ...  e  *  G  ♦  H.  Each  Xj  is  the  union  of  two  cone  graphs  we 

i 
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cad  call  Gj  and  Hj.  The  groups  Wj  a  •••  =>  Wt  can  now  be  described  as 
Wj  =  Ai(Gj.Hj.z)Ui_1(G.H,a)/Ui_1(G.H.z). 

We  do  not  know  whether  the  tower 

3  Wj  3  •••a  Wt_j  3  V1  3  3  Vr  s  I  is  polynomial  ly 

accessible.  We  can  show  that  the  index  of  each  group  in  the  next  is 
bounded  by  a  polynomial  in  n.  but  we  don't  know  whether  the  Wj  are 
recognizable  in  polynomial  time. 

Hoffmann  used  Babai's  coin  tossing  algorithm  to  recognize  Wj  in 
time  0(ncl).  Using  our  improvement  to  Babai's  algorithm  we  can  recognize 
elements  of  Wj  in  deterministic  time  0(nci).  It  is  because  of  this  step 
that  the  algorithm  computing  A j0gn  runs  in  time  0(nc*°®n), 

The  graph  Xj+J  is  Xj  together  with  d-ary  hyperedges  between  the 

leaves  of  subtrees  rooted  at  some  vertices  a^»...*ad  and  z(aj ) . . . . »z(ad) 

on  level  i.  Adding  these  constraints  to  the  automorphism  group  of  Xj 

can  at  most  restrict  the  allowable  0-1  assignments  to  2d  level  i+1 

2d 

vertices.  Therefore,  the  size  of  Wj/Wj+j  is  at  most  2*2  »  which  is 

2k+l 

less  than  the  constant  2  . 

Now  we  turn  to  the  problem  of  determining  whether  two  elements  x 
and  y  of  are  in  the  same  coset  of  W j_^/W j •  This  is  the  case  if  and 

only  if  f  *  x”*y  is  in  A^(Gj ,Hj,z)U^_j(G,H,z) .  The  permutation  f  is  in 
the  product  of  these  groups  if  and  only  if  there  is  a  u  in  U^_^(G.H.z) 
such  that  uf  is  an  automorphism  in  A^(Gj.Hj.z). 

The  graph  f(Cj  ♦  Hj)  consists  of  two  cones.  f(Gj)  and  f(Hj).  For  u 
in  U^.^(C.H.z).  uf  is  in  A^(Cj.Hj.z)  if  and  only  if  the  graph 

A 


* 


uf(G.)  +  uf(H.)  is  isomorphic  to  G.  *  H..  There  are  only  two  ways  this 

J  J  J  J 

isomorphism  can  work  and  they  correspond  to  the  following  two  cases. 

Case  1:  uf(G.)  is  isomorphic  to  G.  and  uf(H.)  is  isomorphic  to  H.. 

J  J  J  J 

Such  a  u  exists  if  and  only  if  there  is  a  u~  in  A*  ,  (G . ,f(G •) ,f ) 

G  l-X  j  j 

that  maps  Gj  onto  f(Gj)  and  a  uH  in  A£mj(Hj,f(Hj) ,f )  that  maps  Hj 
onto  f(Hj). 

Case  2:  uf(Gj)  is  isomorphic  to  Hj  and  uf(Hj)  is  isomorphic  to  Gj. 

Such  a  u  exists  if  and  only  if  there  is  a  uG  in  A^^CGj.fCUj)  .fz) 
that  maps  G.  onto  f(H.)  and  a  u„  in  A-  . (H.,f(G .) ,fz)  that  maps  H. 

J  J  n  j  j  j 

onto  f(G.). 

J 

In  either  case*  testing  for  the  existence  of  a  u  in  U^^(G»H»z) 
requires  the  construction  of  two  A^’s.  To  construct  A^.,  order  n^,  for 
some  constant  d»  tests  of  memebership  in  Wj  must  be  carried  out.  Thus, 
if  T(i)  is  the  time  to  construct  A^»  T(i)  £  4n^T(i-l)  £  0(nc^). 

Therefore*  constructing  Aj0gn(G,H,z)  ^y  this  method  takes  time 
0(nc*ogn)»  for  some  constant  c. 


To  compute  generators  for  the  automorphism  group  of  a  single  cone 
graph  G  whose  hyperdeges  are  at  most  k-ary»  for  some  constant  k*  we  use 
the  following  theorem. 

Theorem  $.2:  Let  C  be  a  cone  graph  whose  byperedges  are  at  most  k-ary. 
The  automorphism  group  Ac  of  G  mapping  the  root  onto  itself  can  be 
determined  in  time  0(ne*ogn). 
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Proof  s  Find  A*  the  automorphism  group  of  G  +  G.  in  time  0(nc^ogn). 
Construct  the  polynomial ly  accessible  tower  A  s  3  Aj  3  ...  m  AQ  =  I» 
in  which  the  fix  successively  more  vertices.  Using  this  tower  obtain 
generators  for  Aq. 

0 

6.  An.  0(ncl°8°)  Irivaleat  graph  isomorphism  Algorithm. 

Having  established  all  the  group  theoretic  tools  and  algorithms  of 
the  previous  sections  we  can  at  last  describe  how  to  determine 
generators  for  the  automorphism  group  of  a  trivalent  graph  G  with  one 
edge,  e  =  (a.b).  fixed.  The  next  theoran  tells  us  that  this  suffices  to 
solve  the  isomorphism  problem. 

Theorem  6.1:  Trivalent  graph  isomorphism  testing  is  polynomial-time 
reducible  to  computing  the  automorphism  group  of  a  trivalent  graph  with 
one  edge  fixed. 

Proof  :  Let  G  and  H  be  two  connected  trivalent  graphs.  Pick  any  edge  e 
in  G  and  add  a  new  vertex  v  to  G  on  this  edge.  Pick  any  edge  ef  in  H 
and  add  a  new  vertex  v*  to  H  on  this  edge.  Call  these  two  graphs  G*  and 
H'  respectively.  Construct  a  new  graph  X  that  is  G*  +  H*  together  with 
a  new  edge  between  v  and  v’.  Compute  the  automorphism  group  of  X  that 
fixes  (v.v').  If  there  is  a  generator  that  interchanges  G'  and  H*  then 
G  and  H  are  isomorphic.  By  trying  this  for  every  possible  choice  of 
edge  e'  in  H  we  can  determine  if  G  and  H  are  isomorphic. 

0 
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6.1  The  Algorithm 


Take  the  vertices  of  G  and  label  them  according  to  their  distance 
from  the  edge  e.  Let  the  group  A^  be  the  automorphisms  of  G^,  the 
subgraph  consisting  of  vertices  and  edges  out  to  distance  i  from  e.  The 
graph  Gq  is  just  the  single  edge  (a.b),  and  Aq  is  the  group  of  order  two 
consisting  of  the  identity  and  the  permutation  that  interchanges  a  and 


It  is  our  intention  to  compute  A^  from  A^. 

A.  is  a  2  group.  Let  A^  be  its  action  on  the  level  i  vertices, 
also  a  2  group.  Construct  Syl(A^),  a  2SSG.  of  the  symmetric  group  on 
level  i  vertices  that  contains  A^. 

Form  a  cone  graph  from  the  tree  representation  of  Syl(A^)  by 
taking  each  vertex  of  level  i+1  and  creating  a  hyperedge  out  of  the  set 
of  level  i  vertices  it  is  adjacent  to.  Using  the  modified  version  of 
Hoffmann's  algorithm,  calculate  H^,  the  automorphism  group  of  this  cone 
graph.  Let  be  restricted  to  the  level  i  vertices. 

The  group  H^flA^  consists  of  just  those  permutations  of  level  i 
vertices  that  can  be  extended  to  automorphisms  of  G^+j.  Generators  for 
H^nA^  can  ke  determined  in  polynomial  time  since  both  groups  lie  under 
Syl(A^) .  The  automorphism  group  A^+^  will  be  constructed  by  extending 
X  =  H^nA^  to  act  on  G^ . 

To  get  at  A^+j  we  first  construct  B^»  the  subgroup  of  A^  whose 
restriction  to  level  i  vertices  is  in  X.  To  test  whether  an  element  y 
is  in  B^,  we  can  restrict  y  to  operate  on  the  level  i  vertices  and  te6t 


i 
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i£  the  restriction  is  in  X.  Therefore,  is  polynomial- time 
recognizable. 

When  X  was  constructed,  a  polynomially  accessible  tower  from 
through  X  to  I  could  have  been  found.  Let 

n  Dj  =>  •••mDt=Xm  •  •  •  =>  I  be  this  tower.  Define  Rj  to  be  the 
subgroup  of  A^  which,  when  restricted  to  level  i  vertices,  is  in  Dj. 

The  group  can  be  trapped  in  the  polynomially  accessible  tower 
Ai  3  Rj  s  •••  3  Rt  =  Bi  3  Cj  3  3  Ii  in  which  the  Cj  are  just  groups 

fixing  successively  more  vertices.  From  this  tower,  generators 
b^,...,br  for  B^  can  be  found  in  polynomial  time.  Having  these 
generators,  B^  can  be  extended  to  A^. 


Let  F^+j  be  the  subgroup  of  A^+j  in  which  level  i  vertices  and 
below  are  fixed.  Find  generators  for  F^  by  direct  examination  of  the 
graph  Gi+1«  For  each  bj,  consider  its  action  on  level  i  vertices  and 
pick  any  extension  bj  that  includes  level  i+1  vertices  and  is  an 
automorphism  of  G^+^.  Generators  for  A^+j  are  the  bj  together  with 
generators  for  Fi+r 


6.2  Timing  Analysis 

The  only  step  that  takes  more  than  a  polynomial  amount  of  time  is 
determining  the  automorphism  group  of  a  cone  graph.  The  number  of  times 
this  step  is  performed  corresponds  to  the  number  of  levels  in  the  graph, 
which  is  at  most  n.  Therefore,  the  whole  algorithm  runs  in  time 
0(nclo*n). 
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